Unified Incremental Multimodal Interface for Human - Robot Interaction
نویسندگان
چکیده
Face-to-face human communication is a multimodal and incremental process. Humans employ different information channels (modalities) for their communication. Since some of these modalities are more error-prone to specific type of data, a multimodal communication can benefit from strengths of each modality and therefore reduce ambiguities during the interaction. Such interfaces can be applied to intelligent robots who operate in close relation with humans. With this approach, robots can communicate with their human colleagues in the same way they communicate with each other, thus leading to an easier and more robust human-robot interaction (HRI). In this work we suggest a new method for implementing multimodal interfaces in HRI domain and present the method employed on an industrial robot. We show that operating the system is made easier by using this interface.
منابع مشابه
Dual Track Multimodal Automatic Learning through Human-Robot Interaction
Human beings are constantly improving their cognitive ability via automatic learning from the interaction with the environment. Two important aspects of automatic learning are the visual perception and knowledge acquisition. The fusion of these two aspects is vital for improving the intelligence and interaction performance of robots. Many automatic knowledge extraction and recognition methods h...
متن کاملDecoupling of Modality Integration and Interaction Design for Multimodal Human-Robot Interfaces
The development of a multimodal Human-Robot Interface (HRI) involving mixed-initiative and context-awareness is complex and laborious. The integration of individual modalities (e.g., gesture recognition or speech output) and the design of natural human-robot interaction are two different tasks that both require their own expertise. In this paper, we consider three different roles that participa...
متن کاملMultimodal Human-Machine Interaction for Service Robots in Home-Care Environments
This contribution focuses on multimodal interaction techniques for a mobile communication and assistance system on a robot platform. The system comprises of acoustic, visual and haptic input modalities. Feedback is given to the user by a graphical user interface and a speech synthesis system. By this, multimodal and natural communication with the robot system is possible.
متن کاملRequirements and Building Blocks for Sociable Embodied Agents
To be sociable, embodied interactive agents like virtual characters or humanoid robots need to be able to engage in mutual coordination of behaviors, beliefs, and relationships with their human interlocutors. We argue that this requires them to be capable of flexible multimodal expressiveness, incremental perception of other’s behaviors, and the integration and interaction of these models in un...
متن کاملToward Robot Adaptation of Human Speech and Gesture Parameters in a Unified Framework of Proxemics and Multimodal Communication
In this work, we present our unified framework of proxemics and multimodal communication based on static data-driven models of how social signals (speech and gesture) are produced and perceived by both a social robot and a human user, and propose extensions to enable dynamic model adaptation of these human communication parameters.
متن کامل